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Abstract 

It is known that with the increasing complexity of technological systems that operate in 
dynamically changing environments and require human supervision or a human operator, 
the relative share of human errors is increasing across all modern applications. This 
indicates that in the analysis and control of such systems, human factors should not be 
eliminated by conventional formal mathematical methodologies. Instead, they must be 
incorporated into the modelling framework giving rise to an innovative concept of human- 
centered automation. 

In this paper we analyze mathematically how such factors can be effectively incor- 
porated into the analysis and control of complex systems. As an example, we focus 
our discussion around one of the key problems in the Intelligent Transportation Systems 
(ITS) theory and practice, the problem of speed control, considered here as a decision 
making process with limited information available. The problem is cast mathematically 
in the general framework of control problems and is treated in the context of dynamically 
changing environments where control is coupled to human-centered automation. Since in 
this case control might not be limited to a small number of control settings, as it is often 
assumed in the control literature, serious difficulties arise in the solution of this problem. 
We demonstrate that the problem can be reduced to a set of Hamilton-Jacobi-Bellman 
equations where human factors are incorporated via estimations of the system Hamilto- 
nian. In the ITS context, these estimations can be obtained with the use of on-board 
equipment like sensors/receivers/actuators, in-vehicle communication devices, etc. The 
proposed methodology provides a way to integrate human factor into the solving process 
of the models for other complex dynamic systems. 

Key words: complex dynamic systems, artificial intelligence, speed control, intelligent trans- 
portation systems, human factors, Hamiltonian estimations. 
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1 Introduction 



It is generally accepted that much of human intelligence can be characterized as the ability 
to recognize complex patterns, to analyze them and, if possible, to control. In this process 
the visual system, among others, together with cognition play a central role ([3], p. 11). In 
creating advanced technological systems human factors modelling must be incorporated as the 
processes of complex pattern recognition, their analysis, and ultimately control are intrinsically 
hierarchical. In this contribution we demonstrate how this can be achieved on an important 
example from the ITS theory - the problem of speed control. The main reason for this choice 
lies with the fact that while being strongly dependent on human factors, efficient speed control 
is known to be one of the key problems in the ITS technology [H EJ El El] . For the purpose 
of this paper we limit ourselves to three main technological analogies of human intelligence 
mentioned already, pattern recognition, analysis, and control. In the context of ITS technology 
such analogies are pertinent to (a) the application of information-driven functions (software 
for both control and computation) and (b) communications systems to controlling traffic (i.e. 
operating transport effectively, handling emergencies and incidents if they arise, automating 
driving and safety, etc). These aspects are in the heart of the development of intelligent vehicles 
and highway systems (e.g., [9] and references therein). 

Having specified our focus area from where all our examples will be drawn, we note further 
that our discussion will be pertinent to mathematical models for the development of auto- 
mated driving strategies based on a regulated speed control. Such strategies are important 
in many areas including collision avoidance (e.g., control the vehicle with respect to a vehicle 
running ahead, control the merging process into a main traffic steam where the "target" ve- 
hicle is running), the minimisation of the fuel consumption, etc. Under the requirements of 
increased safety, minimisation of the fuel consumption, and strict environmental constraints 
imposed by the government, many automotive and transport engineering companies have in- 
creased their attention to this problem [U El E3 El EH El El El]- The increased complexity 
of intelligent transportation systems in this area and the successful development of automated 
driving strategies require accounting for human-related design factors and the integration of 
these factors into mathematical models used. These factors remain an important link in a 
chain of automated driving strategies developed from the application of mathematical models. 
Although there is no general model describing the dynamics of human interaction with complex 
systems in dynamically changing environment [231 [TO] , by analyzing existing approaches applied 
previously to some model transport problems, in this paper we suggest a simple and efficient 
way to account for human factors in the solution of the speed control problem by considering 
a sequential HJB-equation-based approximation of the system Hamiltonian. Human-centered 
technologies are used frequently in many applications, including artificial intelligence [35, 39J. 
As pointed out in [T7], although much system development is still currently done by using a 
technology-centered approach (that is automating the functions the technology is able to per- 
form), we witness an increasing- in- importance potential of human-centered design where we 
combine skilled human and automated support. This relatively new paradigm, has already 
demonstrated its importance in complex system development where intervention of humans is 
still necessary on supervisory basis and/or at certain stages of system evolution (e.g., [22] and 
references therein). Nevertheless, the body of literature in this area is minimal [H E21 E5], let 
alone mathematically rigorous developments. 

From a methodological point of view the approach we develop in this contribution can be 
viewed as a blend of control and human-centered automation aspects in the design/control of 
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intelligent transportation systems where we have to satisfy often competing requirements of 
human and technological objectives accounting for their capability limitations and constraints 
[TO] . The proposed approach is generic enough to be applicable to system developments in 
application areas outside of the ITS domain. Finally, we note that our approach has much in 
common with the paradigm of supervisory control [201 [26] where, in the context of our problems, 
the control algorithm should respond in real time to changing conditions where the underlying 
process can be represented in a space of discrete events [27]. Taking this point of view into 
account, we structure the rest of this paper as follows. 

• In Section II we provide a general mathematical framework for controlling complex systems 
by using continuous and discrete control settings. The discussion is given in the context of the 
ITS speed control problem. 

• In Section III we consider a specific example of the speed control problem subjected to the 
minimization of the fuel consumption. 

• In Section IV two important approaches to the development of automated driving strategies 
are discussed and difficulties in their computational implementation are analyzed in detail with 
exemplification given for the problem considered in Section III. In this section it is also shown 
that the general speed control problem can be reduced to a model based on the solution of HJB- 
type equations where human factors are incorporated naturally via estimations of the system 
Hamiltonian. 

• Concluding remarks are given in Section V. 

2 Mathematical formulation of the problem, exemplified 
for advanced vehicle system control 

While the formulation given in this section can be easily adapted to control of other complex sys- 
tems, we exemplify our discussion here with an example concerning control of advanced vehicle 
systems. The model-based computer-aided control has become an intrinsic component of ITS 
technology. Due to the increased complexity and tight coupling of many different constraints 
imposed on the automotive systems development process, this control becomes increasingly 
important [36] . Such constraints come from the growing environmental and economic concerns 
leading to the rising customer expectations for fuel economy, performance, tightening emission, 
etc. There is a growing expectation that these constraints could be resolved by developing ad- 
vanced transportation technologies [21] . Since many of these constraints are dependent strongly 
on the choice of driving strategies, this leads to the necessity of coupling control with human- 
centered automation at the level of modelling rather than at the stage of system utilization. 
Human-centered automation is a relatively new concept that plays an increasingly important 
role in new technologies, both military and civil [TQl [22] . While computers are in the heart of 
control of most complex man-designed systems, full automation is often either not feasible or 
not reasonable, in particular if system and/or environment conditions are rapidly changing. In 
situations like this, function allocation and coupling between human factors and automation 
become critical [22]. In this contribution, we demonstrate that this coupling can be treated 
formally via a sequential estimation of the system Hamiltonian, providing an important tool in 
theory and applications of ITS and other complex systems. 

First, we formulate the problem of interest in the general framework of control problems 
providing all the explanations on an example of the analysis of the situation on the road 
during the interval time [0, T], followed by the subsequent development of automated control 
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strategies for road participants (driver- vehicle subsystems). This problem can be formulated as 
minimization of the following functional 

J(u,v)=/ / (x(t),t,v(t),u(t))dt^min, (2.1) 
Jo 

where v, u are M. m — > IR 7 ™ functions that represent the velocity and control of the entire dynamic 
system consisting of m subsystems (m G N, e.g. the number of vehicles), and the function f is 
the objective (problem-specific) function that could characterise fuel consumption, emissions, 
etc (or a combinations of those quantities incorporated via corresponding weights). In (12.11) T is 
the prescribed (or estimated maximum) time, e.g. the time of reaching the final destination, v = 
d x 

— — , x(£) = (xi, x 2 , x m ) G lR m is the position of the road participants at time t with applied 
at 

(speed) control u. The dynamics of coupling between the velocity and control is governed not 
only by (12.11) but also by the state constraints that are assumed to have the form of the equation 
of motion 

^ = f(x,t,u(f)) (2.2) 

and/or second Newton's law 

— = F(x,t,v(t),u(£)). (2.3) 

The vector functions f and F can be viewed as problem-specific approximations to the velocity 
function and acceleration (see e.g. [T3J, [37] for some specific examples). 

The qualitative (and quantitative) behaviour of the solution of this problem will be deter- 
mined at a large extent by control constraints [26J, defined here as 

u(-) GW(t,x), (2.4) 

where U(t,x.) is a given space-time set. It should be noted that for the solution of the speed 
control problem for transport engineering systems both groups of models, with continuous 
control and with discrete control, have been used in the literature (see, e.g., [12] and references 
therein). Although models with continuous control have limited applicability in this context 
(moreover, their analysis typically requires the assumption of a finite number of control settings 
[13J ) , they provide an important insight into more realistic models with discrete control. A 
major difficulty with the existing approaches based on continuous control models becomes 
transparent at the computational level where the quality of results depends heavily on the 
number and the form of a priori chosen control (traction) phases (e.g. power, coast, brake). A 
similar difficulty exists for models with discrete control settings, where the total number and 
locations of "switching control points" largely determines the quality of computational results. 
More precisely, the "switching control point" problem can be reduced to the determination of 
"optimal" times 

= t < ti < ... < t n (2.5) 

which correspond to such a partition of the vehicle trajectories x fc = x(t^), k — 0, 1, ...,n that 
control at those points makes the entire trip optimal in some specified sense. In conventional 
approaches, the responsibility on choosing the precise sequence of control settings and the de- 
termination of the "optimal" positions of these switching points can implicitly be shifted to the 
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driver [H]. However, this becomes undesirable in the context of ITS where the driving strategy 
should be automated effectively to minimise the probability of accidents and to satisfy other 
goals of traffic control. Since the performance of the entire dynamic system can be improved 
greatly by increasing the number of discrete control settings, the ITS technology can provide an 
effective way to achieve these goals by implementing highly efficient driving control strategies 
on automated highway systems (AHS), a next generation of road systems that are intended to 
resolve various traffic issues [34] . Such driving strategies can be developed from the solution of 
problem (I2.ip - (I2.4I) for a sufficiently high number n in (12. 5p . The practical implementation of 
such strategies for large n will require the installation of on-board equipment such as actuators 
for controlling the breaks and throttle, LCX (leakage coaxial cable) receivers, as well as a laser 
radar and inter- vehicle communication devices. Then, in principle, the vehicles can be operated 
according to a vehicle velocity command (the indicated vehicle speed, road grade, road curva- 
ture, and accident information) received from the LCX cable installed alongside the road, that 
allows for automatically maintaining a safe vehicle speed and headway distance. We empha- 
size that in this case, the definition of switching times (I2.5P will be made sequentially on the 
basis of information accumulated by the given moment of time, as opposed to the conventional 
techniques based on one of the a priori choices of switching times. 

An example involving one vehicle only is discussed in the next section in order to clarify 
the meaning of functions in general control problem ( 12.1[) ( T275T) and to lay the foundation for 
further discussion of the key issues related to the solution of this problem in the context of ITS. 

3 Conventional approaches on the example of vehicle 
speed control subjected to minimization of fuel con- 
sumption 

The literature on different aspects of control of transportation systems is vast (e.g., [121 Ell 
1321 HQ] to name just a few). A number of authors have attempted to apply different variants 
of continuity principle to determine switching control times (where, e.g., intervention of the 
driver is required). A continuity hypothesis found also its application in continuum (ffuid- 
dynamics-like) approaches that have been developed for traffic flow models. In the latter case, 
such models rely frequently on unrealistic sets of assumptions and an a priori optimal velocity 
is one of them. More recently, several interesting contributions have been made to this area 
where authors realized that the underlying problem can be modelled with a hyperbolic system 
(with no conservation of momentum, e.g. jll] and references therein). However, the authors of 
these recent papers do not discuss control issues and that is where major challenges lie. 

Let us explain the situation on an example of vehicle speed control subjected to the mini- 
mization of the fuel consumption. First note that in a number of practical situations the general 
formulation of problem (I2.ip - (I2.4I) can be simplified considerably by assuming that control and 
state aspects of the dynamics of the moving vehicle could be decomposed (or factorized) in the 
objective function, i.e. if we assume that 



where p and q are given functions. For example, according to [13], for a problem where the total 
mechanical energy consumed by the vehicle is given by (12.11) and (13.11) and control is subject to 
the minimization of the fuel consumption, the above functions can be defined in the following 




(3.1) 
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forms (note that m is set to 1 in this case) 

P = u+{t) = ^[u(t) + \u(t)\], q = v(t). (3.2) 

As pointed out in [13] , Eq. f)3.2p makes sense when a maximum applied acceleration is specified 
and that only positive acceleration consumes energy. We note further that specific forms of 
constraints (12.21) and/or (I2.3P depend on the nature of the problem at hand, and since the vehicle 
dynamics can be influenced by the engine, automatic transmission, breaks and by many other 
factors, the constraints can appear to be fairly complex in the general case. Nevertheless, for a 
number of important situations state constraints can be reasonably simplified. For example, it 
is often assumed that the control variable is the applied acceleration and that this variable can 
be determined as the difference between the "controlled" acceleration function s(u, v ) (from a 
physical point of view this function can be interpreted as the driving controlled force per unit 
mass of the vehicle) and the "uncontrolled" deceleration function r(v) of the vehicle. In this 
case equation (I2.3P takes the form 

dv 

— = s[x, u(t),v(t)} - r[x, v(t)], (3.3) 

where possible dependency of functions s and r on the position x has been also included. 
This can be simplified further. Note that the form of the deceleration is again problem-specific 
depending on the need to account for a number of factors such as contributions of gravitational, 
aerodynamic, frictional and other forces. In the simplest case it can be approximated by 
the difference between the frictional resistance, r , and the gravitational component g in the 
direction of the vehicle motion Hi 



r[v(t)] = r [v(t)]-g(x). (3.4) 

Note also that ( 13 .41) often takes the form of a quadratic law (so-called Davis' formula) 

r[v(t)} = a + bv + cv 2 a, b, c G JR. (3.5) 

It is often the case that additional inequality constraints come naturally into the formulation of 
the problem. For example, the definition of the control variable might require further constraints 
such as positivity of the velocity and some control admissibility conditions (e.g. [T3] ) 

?;(*)> 0, |«(t)|<l. (3.6) 

These constraints can be supplemented by additional constraints such as an upper limit on 
velocity. Inequality constraints (13.61) can be cast in the general vector form as 

G < 0, with G x = -v, G 2 = u 2 -1. (3.7) 

Furthermore, some equality constraints might be also required. For example, if we assume 
that the trip has length L, this leads to the equality constraint expressed by the end-point 
reachability condition 

T 

v(t)dt = L, (3.8) 



o 



supplemented by the boundary conditions 

v(0) = v u v{T) = v 2 (3.9) 
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taken typically with V\ = v 2 = 0. 

Next, we note that the above example can be reformulated in the general framework (12. ip - 
(I2.4p by introducing vector x = (xi,x 2 ) 1 with x\ being the state variable, and x 2 being the 

dx\ 

velocity of the vehicle. Indeed, since — — = v, we can use (13. 9 p to derive that 



dt 

Xi(T) — xi(0) = L. (3.10) 
Then, taking into account (13. 9p we have the initial and terminating conditions in the form 

x(0) = 0, x(T) = x T , (3.11) 

where x T = (L, 0)'. We denote 

f(x, t,u(t)) = (x 2 ,s[x 1 ,x 2 ,u 2 \ - r[xi,x 2 ]) t , (3.12) 

where u 2 plays the role of u in the above example, u = (0,u 2 (t)Y, and take into account (13.71) 
and ( 13.111) . i.e. only admit controls 

u(-)eW(*,x), (3.13) 

where 

W(t,x) = (u(-) eU°(t) : x 2 (t) > 0, 

x(T) = x T , \u 2 (t)\ < 1}. (3.14) 

Then, the definition of the objective function in the form (see (13. ip ) 

fo(^(t),t,u(t)) = [u 2 (t)] + x 2 (t) (3.15) 

completes the formulation of the vehicle speed control problem subjected to the minimization 
of the fuel consumption in the general framework (I2.ip - (I2.4I) . 

Now, we are in a position to highlight major difficulties in applications of conventional 
methodologies to the above problem. First, we note that in reality the control variable of this 
problem cannot vary continuously due to the discrete character of the information [27] obtained 
in this specific case by the moving vehicle in a dynamically changing environment. Therefore, 
if we consider a finite (possibly very large) set of control settings, for example, throttle settings 
as it was originally proposed in [13] 

- 1 = u 1 < u 2 < ... < u n = 1, (3.16) 

then the analysis of the problem can be reduced (under some severe assumptions such as "no 
speed limits") to the consideration of four basic situations, as shown in [T3] (the acceleration, 
speedholding, coasting, and breaking phases), making use of quite specific forms of functions 
(13. 2p . In such cases it might be easier to define the objective function of the total fuel consump- 
tion accounting for these settings by splitting the total distance on an appropriate number of 
sub-intervals according to the discrete dynamic equation x k = x(t]~) with 

= x° < x 1 < ... < x n = X (3.17) 

and by assuming that the time Ati+i = t i+ i — U required to complete the segment trip [xi, x i+ i] 
is known (or can be well approximated) for all i = 0,1, n— 1 (see (12. 5p ). In most conventional 
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approaches referenced here it is assumed that each control setting determines a constant rate 
supply. If we denote the the fuel consumption and the control setting in the interval 
by Cj+i = c[-u l+1 ] and u l+1 (c = if u < 0), respectively, the cost (fuel consumption) functional 
of the entire trip can be defined as [3U [H] 



First observe that since in the general case all control settings q+i, i = 0,l,...,n — 1 are 
functions of time, a more rigorous approach should be based on the consideration of functional 
( 12. ip rather than function ( 13.181) . We observe also that in some cases (including more realistic 
situations with speed limits), the development of automated (optimal or sub-optimal) driving 
strategies can be reduced to the analysis of simple combinations between a small number of 
control settings (e.g., power when u = 1, coast when u — 0, and break when u = —1). However, 
due to the very nature of the control problem where we have to consider the ITS in a dynamically 
changing environment, a more detailed sequential analysis of the whole information sequence 
(I3.16P is required. Such an analysis is intrinsic to other control problems where complex systems 
require human supervision or a human operator. The proposed methodology for this analysis 
is discussed in the next section. 

4 Sequential analysis of the global Hamiltonian keeps 
the key to efficient driving strategies 

In the context of our example, the information sequence for the decision making process ob- 
tained by on-board LCX receivers and by inter-vehicle communication devices always contains 
a certain degree of uncertainty. Indeed, some of the vehicle parameters, as well as the infor- 
mation on road conditions, can be known only partially [37J. A complex dynamics of human 
performance in traffic systems [33J brings along another factor that complicates the analysis 
of the entire dynamic system consisting of many driver-vehicle subsystems. This leads to a 
situation where control cannot be limited by a simple combinations of basic settings, as we 
have discussed in the previous section, and a general approach should be developed to address 
the speed control problem in the ITS context. 

The development of speed control strategies for intelligent transportation systems has be- 
come an important and topic of research [23, HE]. In this section, our discussion focuses on 
a subset of the systems that consist of vehicles capable of measuring/estimating dynamic in- 
formation from the target (typically, the immediate front) vehicle by its on-board sensors. 
The computers in the vehicles can process the measured data and generate proper throttling 
and breaking actions for controlling vehicles' movements under the constraints of safety, ride 
comfort, fuel minimization, etc. Recall that algorithms for speed control with constant ac- 
celeration/deceleration were developed and tested together with some simple algorithms for 
"approach" and "merging" control [I]. The authors of [I] developed linear models for pas- 
senger cars (in which any acceleration/deceleration can be generated according to the driver's 
operations |5J) and generalize their results to a nonlinear model for heavy-duty vehicles where 
they account for transient responses (it is rather difficult to control the speed in this case, 
because of poor acceleration performance of such vehicles). As it was shown, it is necessary 
to account for saturation/delay in acceleration which could be an important characteristic of 
some vehicles. However, the results of simulations conducted in [I] showed that for long control 



n-1 




(3.18) 



i=0 
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periods, the model leads to unrealistic speeds, exceeding the target speed, and the maximum 
vehicle distance could become excessively long. In principle, such overshootings can be avoided 
by setting a short control period. However, since the dynamic behaviour of the vehicle model 
is intrinsically nonlinear and considerably complicated [37], in the general case it is necessary 
to take into account complex dependency between acceleration and speed of the vehicle using 
the general framework of fl2.ip - fl2.4p . 

In the reminder of this section we analyse three main approaches to the solution of the 
general speed control problem with exemplification given for the vehicle speed control subjected 
to the minimization of the fuel consumption, as considered in Section III. 



4.1 The definition of the Hamiltonian via the solution of the adjoint 
problem 

Some of the most powerful methodologies to the analysis of speed control problem are based 
on a heuristic application of the Pontryagin maximum principle. However, the application of 
these methodologies to solving practical problems in the context of intelligent transportation 
systems requires overcoming a number of serious difficulties which will be considered below in 
the case where x G M 2 (see details after (I3.9P in Section III). 

Applying formally the Pontryagin maximum principle [30] to the problem considered in Sec- 
tion III (problem fl2.1l) - fl2.4p allows an analogous treatment), we can introduce a local Hamil- 
tonian of the entire dynamic system in the following form 

2 

H(x(t),u(t),if(t),t) = -oo/ (x(t), u(t),t)+ ^ Vi/i, (4-1) 

i=l 

where all notations come from the consideration of fl2.ip - fl2.4p in this special case, f = (fx, f2) T , 
do is the normalisation factor [26J, while the adjoint vector-function ip = (ipi-,ip2) T is defined 
from the following adjoint system 

* k=l 1 

Then the result of the application of the Pontryagin maximum principle to the speed control 
problem can be formulated as follows [30J. 

Theorem 4.1 For a driving strategy determined by the pair (u(t), x(t)) to be optimal it is 
necessary the existence of an adjoint vector- function ip(t) (components of which are not identical 
zero), defined by h4-!ty such that 

maxH(if(t),x(t),u(t),t) = H(if*(t),x*(t),u*(t),t) (4.3) 
for almost all t G [0, T\. 

Practical difficulties with the application of this approach to the solution of the speed control 
problem for the intelligent transportation systems lie with the fact that state variables in this 
problem are not independent. This fact has led many authors to substantial simplifications of 
the problem (in particular, in the analysis of the system Hamiltonian) by considering a small 
subset of possible control settings [12] . Unfortunately, this idea cannot be applied in the context 
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of intelligent transportation systems, because both state variables are closely linked with the 
control function u, and they might be decoupled in some special situations only. 

Consider, as an example, the problem discussed in Section III. In this case, functions partic- 
ipating in the definition of Hamiltonian (14. ID can be specified more precisely. Indeed, recall that 
in this case function /q takes the form (13.151) . while the vector function f can be specified by 
its components as in (I3.12p . Clearly that even in this relatively simple case the state variables 
are coupled with the control by the following systems of equations 

-QjT = x 2, -Qjr = s[x 1 (t),x 2 (t),u 2 (t)] -r[xi(t),x 2 (t)] (4.4) 

supplemented by the corresponding boundary conditions and other constraints previously dis- 
cussed. In this case, according to (14. ip the Hamiltonian of the system can formally be written 
in the form 

H = -a [u 2 ] + x 2 + ipiX 2 + ip 2 {s[x 1 ,x 2 , t, u 2 ] - r[xi, x 2 ]} . (4.5) 

For example, in a special case where s[xi, x 2 , t, u 2 ] = u 2 and ao = 1 [12], control can be confined 
to the following values u 2 — 1, u 2 G (0, 1), u 2 = 0, u 2 e (—1,0) and u 2 = —1 subject to the 
fulfilment of one of the following five relations (a) ip 2 > x 2 , (b) if) 2 = x 2 , (c) < ip 2 < x 2 , 
(d) tfj 2 = 0, (e) ip 2 < 0, respectively. Such a consideration takes the advantage of an implicit 
assumption on the possibility of decoupling state and control aspects of the problem. This leads 
to a substantial simplification of the analysis where we have to account for control constraints 
( I2.4p . In the general case, the analysis cannot be reduced to five basic situations described 
above. Since the intersection between the set defined by control constraints and the set defined 
by state constraints is not empty [26], we note that even under these special assumptions, 
the key to the analysis of the Hamiltonian is kept by the coupled system of equations (14. 2j) . 
(14.41) . Indeed, the adjoint function of the speed control problem considered in Section III is the 
solution of (14. 21) which in the case where s equals u 2 can be written in the following form 

dMt) -r'[v m 2 = F, (4.6) 



dt 



where 



F = F(v ,u ,f J 2 ,c), (4.7) 

df 2 

f 2 : M. — > R is a real function associated with dynamically perturbed function F 2 = — — , 

ox 2 

and ao G 1 is a real constant that can be viewed as a dynamically perturbed parameter 
of normalization, subject to the dynamics of ipi. Getting a specific form of F requires a 
quite delicate analysis which was performed so far only for fairly simple cases (e.g. [131 EG] 
and references therein). The determination of function f 2 and constant ao is also far from 
trivial and in the general case such a determination should be adaptive. Note also that (v , u ) 
in (14.71) is assumed to be a fixed point associated with the optimal velocity of the vehicle 
and its optimal applied control which are not known a priori. However, if an approximate 
solution of the problem (14. 6[) is found, then by using (14. ip a local (or pointwise) Hamiltonian 
function of the system can be defined. In this case, a major source of difficulties in constructive 
approximations of optimal driving strategies (that can be derived formally from minimising the 
local Hamiltonian) lies with the intrinsically complex dynamics of the adjoint function and the 
adequate determination of the normalisation factor. To proceed with such a construction the 
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local Hamiltonian function should be integrated in time over the whole interval [0, T] which 
leads to the global Hamiltonian in the form 

H(u) — H + / H[x 1 ,x 2 ,t,u 2 ,ip 1 ,ip 2 )dt, (4.8) 
Jo 

where the actual value of H e R depends not only on vo, L, and T, but also on the weight 
coefficients for implementing all remaining constraints of the problem. The optimal control 
strategies can now be determined by finding local minima of the Hamiltonian (I4.8p . but in 
practice this approach leads to serious computational difficulties due to too many degrees of 
freedom in (14. 8ft . On the other hand, the problem can be reduced to the analysis of (14. lft . e.g. 
by considering a small subset of basic control settings, only in quite simple cases such as those 
discussed in [13]. 



4.2 Using the embedding principle and the Lagrangian multipliers 

In the context of intelligent transportation systems, more feasible computationally are ap- 
proaches that are based on the embedding principle. First, we introduce the minimum cost 
function as follows 

■T(x(f),f)= min {/ /o(x(T) I u(r),T)dr} l (4.9) 

u(r)e«, t<r<T lJ t J 

where < t < T and f is defined in the context of the problem discussed in Section III. Then, 
it appears that if the derivative of J* with respect to x = (xi,x 2 ) exists, we can introduce a 
local Hamiltonian of the system as follows 

H = -a /o + J* Xl x 2 + J* X J 2 . (4.10) 

In this representation we accounted for state constraints ( 12.21) and ( 12. 3p which in the context of 
problem discussed in Section III have the form (14.41) . Accounting for control constraints (13.61) 
is straightforward [15] 

H = H + \(u 2 -l)+fi(-u 2 -l), (4.11) 

where A and /i can be identified with the Lagrangian multipliers. For this specific case, the 
definition of the Hamiltonian in form (14. lip limits the number of degrees of freedom to two 
(see details of this approach in [31]) where the objective function was taken in the form (I3.18P ). 
However, practical applications of this approach in the context of complex dynamic systems 
are limited due to the discrete nature of control in such problems which leads to non-existence 
dT~L 

of derivative — — in the classical sense. If, however, a formal operation of differentiation is 
ou 

performed, it is easy to conclude that 

^- = 7r ~ + A-/i, (4.12) 
ou 2 ou 2 

where all the derivatives above and hereafter in the text should be understood in a general- 
ized sense. Under some simplifying assumptions this formal approach can be applied to the 
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speed control problem discussed in Section III for which the formal differentiation leads to the 
following result [121 US] 



&H 

du 



%2 + JL + A - fjt, < u 2 < 1, 

(4.13) 

J* 2 + A - n, -l<u 2 < 0. 



In this case, similar to our discussion in Section 4.1, further analysis can be reduced to the 
consideration of five different cases, depending on the mutual location of x 2 , and x 2 + J* 2 
[j~5] . From a computational point of view this approach could be efficient in computing critical 
speeds for automated driving strategies, but in the general case it has the same limitations as 
the approach described in Section A. Of course, in the case of simple control constraints (such 
as (13.61) ). having the optimal velocity Vo(t), it is a standard procedure to determine the optimal 
control (acceleration) Uo(t) by minimising the (local) Hamiltonian function. Since the velocity 
is strongly coupled to control settings over the whole time interval (neither velocity nor control 
can be given a priori V [0, T]), practical implementation of this procedure is problematic in the 
general case. Strictly speaking, in order to determine the optimal velocity and control globally, 
one needs to know the Hamiltonian which in its turns depends on those functions [26]. However 
formally the Hamiltonian (or Lagrangian due to the duality principle) can be defined locally 
provided the coupled system of equations fl4.2[) and (I4.4p is solved. Alternatively, we have to 
solve the coupled system of equations in the Hamiltonian canonical form 

^ = ^(x*(t),u*(t),r(t),t), (4.14) 

d$*(t) dH 
dt dx 

with the function H defined as 



(x*(t),u*(t),^(t),t), (4.15) 



ff(x(*),u(t),V(i),t) = /o(x(t),u(t),t) + 

[^)] T f(x(t),u(t),t). (4.16) 

Then, as follows from Theorem 4.1 for the optimality of control u*(t) and trajectory x*(£) the 
following inequality 

H(x*(t),u*(t),f*(t),t) < H(yi(t),u(t)J(t),t) (4.17) 

should hold for all u(-) £ U, where U is defined by (12. 4ft . It is well-known that under sufficient 
smoothness assumptions [T9l [23] . the adjoint function and the optimal performance measure 
are connected by 

8 7* 

^) = ^-(t,x*(t)), (4.18) 
ax 

and hence the function H in (I4.16P can be re-written in the form 

ff(x(t), u(t), VJ*, t) = / (x(t), u{t),t) + 

[VJ*(x(t),t)] T f(x(t),u(t),t). (4.19) 
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In this case the dynamics of system perturbations (including those caused by human factors) is 
accommodated formally in the derivative of the performance measure. Since complex dynamic 
systems such as ITS exhibit an intrinsic interplay between state and control aspects of the 
dynamics, this accommodation does not preclude us from non-uniqueness of the solution of the 
resulting model. Indeed, following [31] let Vj be the speed of the vehicle at location x^ , Wj 
be the limiting speed for control setting u\ and Uj be the speed at location Xj, where it is 
assumed that the speed limits are changed at distances 

= X < X 1 < ... < X p = X. (4.20) 

Then, triple (Uj, Vj, Wj) can be obtained by using the Lagrangian multipliers under simplified 
assumptions of only three control settings, u — 1, u — 0, and u — — 1. This triple defines 
critical speeds for the interval (Xj-\,Xj) such that < Uj < Vj < Wj < Mj [3Tj. However, 
the quality of the "speed-holding" phase approximation by using, for example, coast-power 
control pairs on each such interval depends strongly on the number of control pairs (denoted 
here by Sj) for this interval. In fact, in the general case only in the limit Sj — > oo we can obtain 
a unique holding speed for this interval and to avoid undesirable vehicle speed oscillations 
between control switchings (e.g. between values Vj < Mj and Vj = mm{Wj, Mj} subject to Sj, 
see the results of computational experiments in [3T]). 

Despite these difficulties, the problem of speed control in its general framework can be for- 
malised by writing down the full system of Kuhn-Tacker necessary conditions and by including 
all constraints in the the globally defined generalised Lagrangian function (or Hamiltonian, as 
follows from the duality principle). Let us consider this approach in some details. Provided 

7i possesses sufficient smoothness, the minimisation of (14. lip is a standard problem in opti- 

OH 

mization theory, and the necessary conditions of control optimality will follow from — — = 

ou 



[T9| [38] . This idea is easy to apply in those cases where control constraints are given a priori 
in a relatively simple form [12] . However, addressing the speed control problem in the general 
case and accounting for a complex dynamic interplay between state and control constraints is 
a much more difficult task. For example, in the case discussed in Section III this problem is 
reducible to the following constrained optimisation problem 

H(x(t),u(t), VJ*, t) -> min (4.21) 



9i(t) < 0, % = 1, 2, 3, 9i (t) = 0, i = 4, 5, (4.22) 

(see ( I3.15p . (14. 9ft . (14.191) ). subject to the following constraints 

9l (t) = u 2 (t), g 2 (t) = -u 2 (t) - 1, g 3 (t) = -x 2 (t), (4.23) 

g 4 (t) = x x (T) - L, g 5 (t) = x 2 (T). (4.24) 

Then, by using classical Lagrangian multipliers for the equality constraints together with re- 
laxing variables jf, i = 1,2,3 for the inequality constraints, we can define the generalised 
Lagrangian function in the following form [38] 

3 5 

L(x(t), u(t), t, \^) = H + J2 U9i(t) + 7- ] + ^9i(t), (4.25) 

i=l i=A 
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where vector A is the vector of Lagrangian multipliers. The Kuhn-Tacker necessary conditions 
for the extremum of this function are 

dL dL dL , . 

W = °' ^T°' ^ = °' Z = 1 ' 2 ' (4 - 26) 

dL 

— = ^ 9i (t) < 0,i = 1, 2, 3, & = 0, i = 4, 5, (4.27) 

= ^ Ai^(t) = 0, i = 1, 2, 3, (4.28) 

9% 



and, finally A; > 0, i = 1, ...,5. (4.29) 

In order to find the solution of the speed control problem we should solve coupled system 
f l4.26p - fl4.29p with respect to unknown variables, xi, x 2 , m 2 , Aj. Since control cannot be found 
globally based on a locally defined velocity function, this system should be solved in an adaptive 
manner. Note that system fl4.26l) - fl4.29l) can be simplified substantially in some special cases, 
for example when local (rather than global) solutions are sought and/or s in the state equation 
f )3.3p is a linear function of control [133 [T2] . Such simplified considerations allow us to reduce 
the analysis of the Hamiltonian/Lagrangian to a small number of control setting, as it has been 
explained earlier in this section. Attempts to apply such methodologies to the general speed 
control problem are confronted with serious difficulties. These difficulties are convenient to 
explain at the computational level for the problem from section III. 
Consider a trajectory of the vehicle with n distinct phases 

Pi = (x\x i+1 ), i = 0,1,..., ri-1, x° = 0, x n = X, (4.30) 

each with certain speed limits Mj + \, and the number Sj + i of control pairs inside of each speed 
limit interval (Xj,Xj +1 ) (for example, "coast-power" pairs to approximate the speed-holding 
phase, etc as argued, e.g., in [31] ) 

(M j+1 ,s j+ i), xe{X„X j+1 ), j = 0, 1, ...,p — 1, (4.31) 

where X = x° and X n = x n . 

The, we ask the following question: What values of n and p should be chosen to approximate 
effectively the optimal trip? A simple way would be to choose these values to satisfy the 
distance and time constraints following the technique described in [13] (e.g. p. 468), and 
then to determine Lagrangian multipliers by using methodology of [3TJ. However, this way 
cannot guarantee global optimality, because additional constraints that appear in the amended 
formulation of the problem (such as speed limits and an a priori pre-defined number of control 
pairs) should be included in the definition of the Hamiltonian (Lagrangian), but they are not. 
If we include these constraints into the definition of the Hamiltonian/Lagrangian, the analysis 
cannot be reduced to only those five case discussed previously in this section. In the general 
case, the number of speed holding phases for the entire trip can be determined by a posteriori 
estimations based on a sequential algorithm of information processing accounting for human 
factors [27J. Recall that in conventional methodologies this number is postulated a priori. At 
the same time, Lagrangian multipliers (see fl4.lip - fl4.13p ) can determine only critical speeds 
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within each interval (I4.3ip . Algorithms for the solution of the general speed control problem 
can be constructed if we take into account that the speed k = l,...,n — 1 at location 
x k for arbitrary (large) n depends primarily on the behaviour of the system on Axi,..., Axk, 
where A X i — X X . We formalize this idea of the Markovian-type controlled dynamics 
below by using Hamiltonian estimations. This allows us to couple control with human-centered 
automation within a general mathematical framework. Note that the model of the system 
as well as the objective function for the minimization as well as constraints are subject to 
uncertainties as a result of dynamically changing conditions in which the system operates. Due 
to such uncertainties, the resulting control strategies may not be optimal in the entire time 
interval in a classical sense. However, they are optimal within each time interval where the 
same Hamiltonian estimation is used. 



4.3 Hamiltonian estimations and human-centered automation 

Effective human-centered automation is a necessary element of a well-designed controlled intel- 
ligent transportation systems. Of course, it is not necessarily a sufficient element for an optimal 
performance of the overall system [20J. However, if human factors are incorporated into a math- 
ematical model, then efficient control of the overall system based on human-centered automation 
becomes a key tool in improving system performance. 

Recall that by (14.91) we introduced the minimum cost function. This function is based on a 
performance measure that allows us to include our speed control problem in a larger class of 
problems by considering the following functional 

J(x(t), t), u(r) : t < t < T, u G U) = 



J /o(x(r),r,u(r))dr, (4.32) 



where t can be any value from the closed interval [0, T] and x(t) can be any admissible state 
value. Now we can follow a general path of the dynamic programming approach (TSJ [35] ■ Since 
our aim is to determine the control that minimizes (I4.32p for any admissible x(t) and for any 
t G [0, T], we note that the minimum cost function for this problem can be re-written by 
subdividing the intervals 

J*(x(t),t) = min <f/ + f dr+ f f dr\ . (4.33) 

From the embedding principle used in the dynamic programming approach (e.g. [T9l [38] ) and 
relationships (14.91) . ( 14.331) we have 

t+At 



r rt+At 

J*(x(t),£) = min { f dr+ 

u(r)eW, t<r<t+At I J t 



J*(x(t + At),t + At)}, (4.34) 

where J*(x(£ + At), t + At) is the minimum cost of the trip for the time interval t + At < r < T 
with the "initial" state x(t + At). Applying now formally Taylor's series expansion in (I4.34p 
about point (x(t),£), we have: 

t+At 



C rt+At 

J*(x(t),t) = min { f dr+ 

u(r)€W, t<r<t+At I J t 
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J*(x(i),t) + 



d.J* 
~dt 



[x(t),t))At + 



<9x 



[x(t),t) 



X 



[x(t + At) -x(t)] + o(At)}. (4.35) 

Then, using the main property of the Landau symbol, taking into account equation (12.21) for 
At — > + , and dividing (I4.35P by At, we obtain 

o dr 



(x(t),t) + min J (x(t),u(t),t) + 
at u(t)ew I 



<9J* 
9x 



(x(t),t) 



[f(x(t),u(t),t)] 



Further, it is easy to see that if we set t = T in (14. 9p we get 

J*(x(T),T) = 0. 



(4.36) 



(4.37) 



If we now define the system Hamiltonian by (I4.19P and take into account that the optimal 

dJ* 

minimising control depends on x, — — and t 

ox 



n 



dJ* \ dJ* 
x(t),u*(x(t),— ,tj,— ,t 



dJ* 

min H ( x(t),u(t), — 
u(t)eu \ ox. 



,t 



(4.38) 



we arrive at a mathematical model for the speed control problem f l2.ip - fl2.4l) represented in the 
form of the Hamilton- Jacob i-Bellman equation 







dJ* 
~dt 



{x(t),t)+H 



dJ* 

x(t),u* ( x (t), — t 



dJ* 
dx ' 



(4.39) 



and supplemented by condition (14.371) . The solution to this problem is understood in the 
generalized sense [231 [26]. Naturally, it cannot be reduced to the five cases discussed before. 
Instead, a sequential (in real time) algorithm is required to incorporate human factors into the 
model via sequential estimations of a time-perturbed Hamiltonian approximation 



H = min H 

u(t)eu, t<r<t+At 



(4.40) 



for each time subinterval t < r < t + At with t G [0,T]. This formulation is more general 
than those resulted from conventional methodologies. Indeed, at each time subinterval the 
Hamiltonian is allowed to change based on the information accumulated up to that point to 
reflect dynamic changes in the environment in which the system operates. A new Hamiltonian 
estimation should be provided based on that information. In the context of intelligent trans- 
portation systems, Hamiltonian estimations can be obtained efficiently with the assistance of 
on-board equipment, including sensors, receivers, actuators, inter- vehicle communication sys- 
tems, and on-board computers. Computational methodologies for solving the problem for each 
Hamiltonian estimation are known as they were developed for the numerical solution of HJB- 
based models (e.g., [TBI El EH])- Finally, a general approach to the analysis of such models 
(obtained via a decision making process with limited information available) using tools of in- 
formation theory and the Markov chain approximation method can be found in 
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5 Concluding Remarks 



Efficiency of models describing the dynamics of complex systems in general, and intelligent 
transportation systems in particular, often depends upon allowance made for human (e.g., op- 
erators/drivers) capabilities and/or limitations of these systems. As a result, the integration 
of human-related design and support activities in the engineering of complex systems become 
important topics of research as exemplified here on the ITS theory and practice. In this con- 
tribution we demonstrated how human factors can be effectively incorporated into the analysis 
and control of complex systems. As an example, the problem of ITS speed control, considered 
here as a decision making process with limited information available, was cast mathematically 
in the general framework of control problems and treated in the context of dynamically chang- 
ing environments where control is coupled to human-centered automation. We demonstrated 
that the problem can be reduced to a set of Hamilton- Jacobi-Bellman equations where human 
factors are incorporated via estimations of the system Hamiltonian. These estimations can be 
obtained with the use of on-board equipment like sensors/receivers/actuators, in- vehicle com- 
munication devices, etc. The proposed methodology provides a way to integrate human factor 
into the solving process of the models for other complex dynamic systems. 
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